STITCHING PAIRS OF LEVY PROCESSES INTO HARNESSES 



WLODEK BRYC AND JACEK WESOLOWSKI 



Abstract. We consider natural exponential families of Levy processes with randomized param- 
eter. Such processes are Markov, and under suitable assumptions, pairs of such processes with 
shared randomization can be "stitched together" into a single harness. The stitching consists of 
deterministic reparametrization of the time for both processes, so that they run on adjacent time 
intervals, and of the choice of the appropriate law at the boundary. 

Processes in the Levy-Meixner class have an additional property that they are quadratic 
harnesses, and in this case stitching constructions produce quadratic harnesses on [0,oo). 
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1. Introduction 

Two ad hoc constructions of quadratic harnesses from transition probabilities led to Markov 
processes that naturally split into a pair of conditionally independent Poisson processes (|3] 
Proposition 4.1]) or a pair of conditionally independent negative binomial processes (|10, Propo- 
sition 5.1]) with random parameters. This paper proceeds in the opposite direction, producing 
harnesses and quadratic harnesses directly from a stitching construction rather than from tran- 
sition probabilities. The appropriate general setting for this approach is to consider natural 
exponential families of Levy processes which come with a parameter ready for randomization, 
and where one can draw on powerful results from [B] to determine randomizations responsible 
for martingale property. 

1.1. Exponential families of Levy processes. We recall the construction of the natural 
exponential family (NEF) of a Levy process from [U Chapter 2]. We consider a Levy process 
(£t) on a probability space (fi, J 7 , P) with the natural (past) filtration T%. Since we will be working 
only with finite-dimensional distributions, we take Q — {/ : [0, oo) — > R} with Tt generated by 
Borel sets that do not depend on the trajectories / after time t. Let L{6) = Eexp(0£i) and 
n(9) = log L(6) be well defined for 9 in an open interval (9 , 9i) C R and let g(dx) be the law of 
£i. We set k{9) = oo outside of (9o,9i). 

The NEF generated by the law P of process (£t) is a measure Pq on the cx-field generated by 
Ut>o such that 

(1.1) P e \ Tt (df) = exp(6f(t) -tK(6))P\ Tt (df). 

Note that (II .ip is just a prescription that generates a consistent family of finite dimensional 
distributions, so such a measure exists on = R^ ' 00 ). It will be convenient to denote by (X^) a 
Levy process on some abstract probability space, with the same finite dimensional distributions 
as the process 3 f i— >■ fit) G R under the law Pq. It is well known ([TJl Section 2.3]) that 

E(xf } ) = f«'(0) and Var(xf } ) = t«"(0). 
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1.2. Stitching construction. We are interested in processes with random 9. To this end, 
we choose a probability measure h(d9) on Borel subsets of (9o,9\) and introduce probability 
measure Q(df) = J Pg(df)h(d9). It will be convenient to denote by (Y t ) any process on some 
abstract probability space with the same finite dimensional distributions as the coordinate process 
ft 3 f !->■ f(t) under Q. Denoting by the random variable with law h(d9), alternatively we can 
view (Y t ) as a process which conditionally on G = 9 has the same finite dimensional laws as the 
process (X t ). An example of such situation is randomized hyperbolic secant process (Example 
14. 51 below) studied in [7]. 

Our goal is to stitch together pairs of randomized conditionally independent Levy processes 
into a single process. To do so, we consider a pair of G-conditionally independent Markov 
processes (Y t ) and {Y() which conditionally on O have the same laws. 

The stitched process, with auxiliary parameters r, v > and p G R, is given by 



;i. 2 ) 



rv ^/(l ^) ^ rv ' ^ — t *\ 1 ; 



I(K'(e)-p/r) 



rv r/(t-l) rv' 1 ^ 1 ' 



We remark that parameter v is used in (II. 2p solely for standardization: in the square-integrable 
case we use it so that Zi has unit variance. To motivate the use of parameters p, r, suppose that 
(Y t + p)/(t + r) is a martingale so that E («'(G)) = p/r. Then it is not difficult to verify that 
(Zj) is a martingale with mean zero. 

We note that (Z t )t>i is the time inverse of (Z t )o <t< i. This observation reduces the number of 
cases to be considered in some proofs. It is also convenient to observe that (Z t )t>o is a Markov 
process. This follows by construction from Markov property of (Y t ) and from 0-conditional 
independence of (Y t ) and (Y{). 

The paper is organized as follows. In Section [2] we investigate conditional properties of process 
(Yt). In Section |3] we show that under appropriate randomization (Z t ) is a harness. In Section H] 
we discuss Levy-Mexiner processes and their randomization. Our main result in Section [5] states 
that stitching of a pair of Levy-Meixner processes gives a quadratic harness. The proof is in 
Section O 

2. Conditional properties of process {Yt) 
Proposition 2.1. (Y t ) is a Markov process with Yq = and with transition probabilities 

(2.1) P Stt (x,dy) = V x \ 9t\s(dy\x), s <t, 

where g t \ s (dy\x) denotes the regular version of the conditional law of £ t given £ s , and 

(2.2) H{t,x)= / e ex - tK{e) h{d9). 

Je 

Furthermore, the transition probabilities for (Y t ) in reversed time are the same as for the Levy 
process (£ t ) ; 

(2.3) PtJy, dx) = g s \ t (dx\y), s <t. 
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Proof. For s\ < s 2 < ■ ■ ■ < s n , let g Su ...,s n (d%i, dx 2 , ■ ■ ■ dx n ) denote the finite dimensional dis- 
tribution of process (&). From (11. ip it follows that the finite-dimensional laws of process (Y t ) 
are 

(2.4) G slt ,„ jSn (dx 1 ,dx 2 , . . • dx n ) = H(s n ,x n )g si) ,„ i8n (dx 1 ,dx 2 , ■ ■ ■ dx n ), 

where H(t,x) is defined in (12. 2p . Since (£ t ) is a Markov process, for any bounded measurable 
functions (p, ip we have 

ip{x n )il){x u x n -i)G Sl .... tSn {dxi, dx 2 , ■ ■ . dx n ) 

<p(x n )ip(xx, x n - 1 )H(s n , x n )g Slt ... tSn (dx 1 , dx 2 , ■ ■ ■ dx n ) 

R" 

ip(x!,. . . ,x„_i) ( f ip(x n ) ^ Snj Xn g^an-! {dx n \x n -i) \ G Su ... tSn _ 1 {dx 1 ,dx 2 ,. . .dx n ^). 



R™- 1 \JR 



So 



E( V (Y Sn )\Y Sl , ■ ■ ■ iY^) = I <p(y) J 1 ^'** , g Sn \ Sn Ady\Y Sn ^) 



and (Y t ) is Markov with transition probabilities (12. ip . 
To verify (12. 3p . note that 



tp(y)ip(x)G Stt (dx,dy) = / ip(y)ip(x)H(t,y)g Sjt (dx,dy) 

R 2 



<p(y) / ip(x)g a \ t (dx\y) H(t,y)g t (dy). 

Now the result follows from (12. 4p . □ 

The following result supplements Proposition 12. 1[ 

Lemma 2.2. Fix s <t < u. The two-sided conditional laws ofY t given Y S ,Y U are the same as 
the two-sided conditional laws £t|£ S) £« of the Levy process (&)■ 

Proof. From (12. ip and (12. 4p . the joint law of Y s , Y t , Y u is given by 

(2.5) -Po,s(0, dx)P Sit (x, dy)P tlU (y, dz) = H(u, z)g Si t, u (dx, dy, dz), 

where g Stt , u (dx, dy, dz) is the joint distribution of £ t , £«)• Fix a bounded measurable function 
<p(x, z). If K(e ia & |£ s , £ u ) = f(£ s , £ u ) is the conditional characteristic function for the Levy process, 
then, since <p(x, z)H(u, z) is integrable with respect to g s ,t,u{dx, dy, dz), we have 



e iay ip(x, z)H(u, z)g sA u(dx,dy,dz) = \ f(x, z)tp(x, z)H(u, z)g sAu (dx,dy,dz). 
So by (J2I5D, we get 

e iay (p(x,z)P 0:S (0,dx)P Sjt {x,dy)P t , u (y,dz) = I f(x, z)ip(x, z)P o , s (0, dx)P Sjt (x, dy)P tiU (y, dz), 



which shows that the conditional characteristic function E(e* aYt |Ys, Y u ) is the same as the condi- 
tional characteristic function E(e lQ ^* |£ s , £ u ). □ 

Next, we use martingale property to determine the class of randomizations that will be used 
for stitching. 
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Proposition 2.3. Denote by g(dx) the law o/£i. We assume that £1 is integrable and that n'(9) 
is h(d9)- integrable. Suppose that one of the following conditions holds: 

(i) The support of g(dx) contains an open interval; 

(ii) The support of g(dx) is non-negative integers, and 9\ < oo; 

(iii) k(6) = e e , so that g(dx) is the Poisson measure on non-negative integers. 

If there are constants p G R ; r > such that (Y t + p)/(t + r) is a martingale with respect to its 
natural filtration, t > 0, then 

(2.6) h{dB) = Ce pe - rK{e) l { o Q , ei ){0)d6. 

Proof. In fact, we only use the following simple consequence of the assumed martingale property: 
there is a pair < s < t such that 

Y s +p 
s + r 

Since the conditional law of Yt — Y S \Y S , G is e ez -(*- s )'H ) g t __ s (dz), we have 



(2.7) E(Y t -Y s \Y s ) = (t-s) 



(2.8) E(Y t -Y s \Y s ,Q) = (t-s)K'(e). 
This implies that 

(2.9) E («'(e)|y.) = ^^. 

s + r 

The joint law of (Y s , G) is 

(2.10) e e y- SK ^g s (dy)h(d9), 

so this is a setting analyzed in [6]. It is clear that for an infinitely divisible family of laws 
{g t (dx) : t > 0}, the support of g s (dx) inherits the property of g(dx) assumed in (i), (ii) or (iii). 
The result follows from [6l Theorem 3] in case (i), from [6l Theorem 4] in case (ii), and from [TT] 
in case (iii). 

□ 

Remark 2.1. The martingale characterization of the law h(d6) in case (iii) is related to |18j . 

To establishes properties of the stitching construction when the law of G is (12. 6p . we rely on 
additional technical assumptions on the Levy process (£ f ). 

Assumption 1. We assume that p G R and r > are such that for all x in the support of g(dx) 

(2.11) lim e (p+z) s ~™W = lim e iP+x)e-rK{d) = ^ 



(2.12) lim K'{e)e ip+x)9 - rK w = lim K \0)e {p+x)e - rK{e) = 0. 

0->0 ( | $-+07 

(In Section H] we give examples of processes (£ t ) that satisfy these assumptions.) 
The following is a converse to Proposition 12.31 under additional assumption (12. lip . 

Proposition 2.4. Suppose a Levy process is integrable, and that the law of G is (12.61) with 
parameters p G R and r > 0, such that (12.111) holds, and that fc'(O) is integrable. Then process 
(Yt + p)/(t + r) is a martingale in the natural filtration. 
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Proof. By Markov property, see Proposition I2.1[ we want to show that 

(s + r)E(Y t - Y S \Y S ) = (t - s)(Y s + p). 

Since (I2.8P holds, using f 12 . 6 j) and (I2.10p we see that it suffices to verify that for a bounded 
measurable ip, we have 

¥{y){y + P- {s + r)n'{e))e^ +p ^ s+r ^deg s {dy) = 0. 
Since £ s , k'(Q) are integrable by assumption, we can switch to iterated integrals 

(2.13) I I \y+p-{s + r)K'{6))e {y+p)e ~ {s+r)R{B) d6 V {y)g s {dy). 

JR. J 6 

Under (12. lip , the inner integral is 

lim e (p+y) v -( r + s ) K ( v ) _ e (p+y)u-(r+s)K(u) _ g _ g 

Once this holds, we get (12. 9p . and then (12. 7p which gives martingale as (Y t ) is Markov. □ 

In particular, since a martingale must have constant mean, we get E(Y^) = tp/r. So if (12. lip 
holds, then from (12. 8p we get 

(2.14) E(k'(6)) = / K'(6)h(d6)=p/r. 



3. Harness property 

The following definition is a Markov version of the well-known concept of a harness, see [H [16] . 

Definition 3.1. Let T = (T ,Ti) C (0,oo). A Markov process (Z t ) is a harness on T, if for 
every s,t,u G T with s < t < u, 

(3.1) E(Z t |Z s , Z u ) = ^^Z s + t -^Z u . 

u — s u — s 

We now show that the randomization laws identified in Proposition 12.31 yield harness. 

Proposition 3.1. Suppose a Levy process (£t) is integrable and that the law of © is (12.61) with 
some parameters r > 0, p e R, such that (12.111) holds and k'(Q) is integrable. Then (II. 2p defines 
a harness on (0, oo). 

Proof. We only need to verify (13.11) for s < t < u < 1 and for s < t = 1 < u. Indeed, if we 
have these two cases, then the remaining cases are handled as follows: the case 1 < s < t < u 
is the time-inversion of0<s<t<u<l. In the case 0<s<t<l<uby Markov 
property E(Z t \Z s ,Z u ) = E(E(Z t \Z s , Z t )\Z s , Z u ) = ^-Z s + |E§ E{Z x \Z s , Z u ). The other case 
0<s<l<i<Mis handled similarly (or by time inversion). Finally, the cases 1 = s < t < u 
and s < t < u = 1 are the limits of cases 0<s<l<t<u and 0<s<t<l<w, respectively. 
To prove (13. 1 p for or s < t < u < 1, denote 

(3.2) s = , t = , u 



1-s l-u 

Since it is known that all integrable Levy processes are harnesses, see e.g. (2.8)], by Lemma 
0we get 

, , , . . 1 - 1 ( u' - f f - s' 

3.3 E(Z t \Z s , Z u ) = 7 Y S , + 7 Y U , 

rv \ u — s u — s' 
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A calculation shows that 



u'-t' t'-s' pt (u-t)Z s + (t- s)Z u 

is' H Yu> = h TV : T7 : , 

u'-s' u'-sf 1-t (l-t)(u-s) 

so the right hand side of (13. 3 j) simplifies to the right hand side of (13. ip . (This part of the proof 
does not rely on (12.61) .) 

To prove (13. ip for or s < t = 1 < u, denote 

(3.4) s' = -— , u' 



1 — s u — 1 

The joint distribution Z s , Z\, Z u (see (11.21) ) is determined from the joint distribution of Y s i, 0, Y' u , 
which by conditional independence is given by 

(3.5) fi{dx,d6,dz) = Ce {x+z+p)e - {r+s ' +u ' )K{e) deg s ,(dx)g u ,(dz). 
To verify harness property, we show that 

(3.6) E(^(e)|yy,K,) = yy + 1 »' +p . 

m + s + r 

Equivalently, we show that for any bounded measurable function ip(x,z), 



(3.7) /// <p(x, z)(x + z + p - (u + s' + r)K'(9))fi(dx,d0,dz) = 0. 




Since we assume integrability, to prove (13.71) we rewrite the triple integral into the iterated 
integrals, with the inner integral with respect to 9. The inner integral is 



\x + z + p - (u' + s' + r)K'{8))e (x+z+p)e - (u ' +s ' +r)K(e) d6 = e ^+p)e-{u'+s'+r)K 



(0) 



6»=6»i 



= 0. 

=00 



(Here we use (12. lip , noting that x + z is in the support of g(dx) by infinite divisibility.) This 
shows that E{Z\\Z S , Z u ) is a linear function of Z s , Z u . A calculation shows that 

/0 oN Y s , + Y^, +p p Z u - Z s uZ s - sZ u 

(3.8) — — = - + v + v , 

u + s + r r u — s u — s 

so (ED follows. □ 

4. Randomizations of Levy-Meixner processes 
Recall that the variance function of a NEF ( [I2| [15]) is a function V such that 

(4.1) k"(9) = V(k'(6)). 

It is known ( [T2"l Theorem 2.11]) that V determines k uniquely. In this section we consider Levy 
processes (£ t ) in the Meixner class [19]. Each such process generates a NEF with a quadratic 
variance function 

(4.2) V(m) = am 2 + bm + c, a > 0, 

see [17]. These processes are square-integrable, and by checking each case we verify that they 
satisfy (I2.11H2.121 . provided r > a. (Restrictions on p vary per case.) 

We now list each of the five cases of Levy processes corresponding to exponential families with 
quadratic variance function V. 
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Example 4.1. Let (£t)t>o be the Wiener process. Then k(8) = 8 2 /2 and k'(8) = 8. The variance 
function (14. ip is V(m) = 1. 

For 8 G (6q,9i) = (—00,00), process (X^) has univariate densities ~ exp( ^ J ~^ ), so it has a 

very simple representation X t = £ t — td. 

Next, consider random G, and (Markov) process (Y t ) t > . If 9 is integrable and there are 
constants p G R, r > such that (Y t + p)/(t + r) is a martingale with respect to natural 
filtration, then formula ( 12. 6p implies that G is normal with mean p/r and variance 1/r. Then 
the moments are: 

E(«'(0)) = E, Var(«/(9)) = i 
It is easy to see that (I2TTT1) . ([Tr2]) hold for p G R, r > 0. 

The following example is closely related to [11] and to [18j Proposition 1]. 

Example 4.2. Let (£t)t>o be the Poisson process with parameter A = 1. Then = e e — 1, 
k'(^) = e 6 *. The variance function (14. ip is V(m) = m. 

For 8 G (^O)^i) = ( — 00,00), process (X^) is a Poisson process with parameter A = e e , so it 
has a very simple representation X t = £ te e . 

Next, consider random Q, and (Markov) process (Y t ) t > . If e e is integrable and there are 
constants p > 0, r > such that (Yt + p)/(t + r) is a martingale with respect to its natural 
filtration, t > 0, then the law of G is 

(4.3) h{d9) = C exp( P 6 - r(e e - l))d6. 

A more natural randomization is A = k'(Q) = exp(Q), then A has gamma G(p,r) law, 

/i(rfA) = -^A p - 1 e- rA l (0 ,oo)(A) C /A. 
T(p) 

Under (Oil . 

E(*/(e)) = E Var(^(9)) = ^. 
It is easy to check that flgHD , d2Tr2p hold for p > 0, r > 0. 

Example 4.3. Let (£t)t>o be the standard gamma process, that is a Levy process for which £1 
is exponential with mean 1. Then k{9) = — log(l — 8), k'(9) = 1/(1 — 8). The variance function 
(143]) is V{m) = m 2 . 

(0) 

For 8 G (80, 8\) = (—00, 1), random variable X\ has the gamma law with density proportional 
to x t ~ 1 e~( 1 ~ e ^ x on (0, 00) so the process has simple representation X t = (1 — 6)£ t - 

Let 6 G (—oo,l) be a random variable and consider (Markov) process (Y t ). Suppose that 
«'(G) = 1/(1 — 9) is integrable and there are constants p, r > such that (Y t + p)/(t + r) is a 
martingale with respect to natural filtration, £ > 0. Then from (12.61) . we see that the law of 9 is 

(4.4) Cil-SYe-^l^^dd. 

So 1 — 9 has gamma G(r + l,p) law i.e., and a more natural parametrization is W = k'(Q) = 
1/(1 — 9) has density 

h ( dw > = r( 1 n 7T2 t (o,oo)(w)dw. 

1 (r + 1) w r+z 

Under (]Op . if r > 1 then 

E(«'(0)) = E, Var(/,'(9)) = 
It is easy to see that (I23B . (T2TT2]) hold for p > 0, r > 1. 
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Example 4.4. Let (£t)t>o be the negative binomial process, that is a Levy process for which £ t 
is Negative Binomial NB(q,t), i.e. 

n6 = ^) = ^y^(l-g)V, A; = 0,1,... 

(Here t > and < q < 1.) Then k(6) = log(l - q) - log(l - ge e ) and k'(0) = ■ The 
variance function (14. ip is V(m) = m 2 + m. 

For G (6*o, 0i ) = (— oo, — log 9) the natural exponential Levy process (X t ) is negative 
binomial with parameter q replaced by qe 9 . 

Let be a random variable with values in (0 o ,0i), and let (Y t ) be the corresponding Markov 
process. Suppose that n'(Q) is integrable, and there are constants p > 0, r > such that 
(Y t + p)/(t + r) is a martingale in its natural filtration for t > 0. Then 

(4.5) /i(d0) = ce ep (l - ge e ) r l ( _ oo ,_ log9) (0)rf0. 

A more natural parametrization is II = qe , which has beta Bj(a, b) law, 



h{dx) = rt)r(bf a ~ 1{1 ~ xy^mi*)^ 

with parameters a = p and b = r + 1. Under (I4.5p . if r > 1 then 

E(k'(Q)) = Z, Var( K '(e)) = 
It is easy to see that (BUI) . (12^2]) hold for p > 0, r > 1. 

Remark 4.1. When G /ias density (14.51) i/ien (3^) zs known as the generalized Waring process 

mum- 

Example 4.5. Let (C,t)t>o be the (symmetric) hyperbolic secant process, with the univariate 
distributions given by ( 14. 6ft with = 0. For e (0o, 0i) = (— tt, tt), we get k(0) = — logcos 2 (0/2) 
and k'(0) = tan(0/2). The variance function ( 14. ip is V(m) = (1 + m 2 )/2. 

(6) (0) 

The corresponding Levy process (Xp) has the marginal density of X\ given by 

(4.6) f(x;t,6)= { ^^ \T(t + ix)\^,t>0. 

Let be a random variable with values in (— tt, tt) and let (Y t )t>o be the corresponding Markov 
process. (This process was studied in [?].) 

Suppose that tan(0/2) is integrable and that there are constants p,r such that (Y t + p)/(t + r) 
is a martingale with respect to natural filtration, t > 0. Then has the following distribution: 

(4.7) h(d9) = C (cos(f )) 2r e p %_^)(0)d0, 

where C = C(p,r) is the normalizing constant that does not depend on 0. 
Under flUZJ), if r > 1/2 then 

2 2 

E(«/(0)) = £ Vai(«'(0)) /r ' '" 



r 2 (2r - 1)' 

(Here we used ( 16.51) to compute the variance.) It is easy to see that ( 12. lip . ( 12. 12ft hold for p G R, 
r > 1/2. 

Remark 4.2. It is known that E(xf } ) = ttan (f) and Var(X t (9) ) = f sec 2 (|). ('To see to, 
differentiate (14.61) wzi/i respect to 9 and integrate the answer with respect to x.) 
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5. Stitching Levy-Meixner processes 

In this section we show that stitching constructions work nicely for Levy-Meixner processes. 
Then the resulting processes are quadratic harnesses that we call bi-Meixner processes. We first 
recall a Markov version of the terminology based on [2]. 

Definition 5.1. Let T = (T ,Ti) C (0, oo). A square-integrable Markov process Z = (Z t ) teT is 
a quadratic harness on T if it fulfills the following requirements: 

(i) Z is a harness on T with the first two moments given by 

(5.1) E(Z t ) = 0, E(Z s Z t ) = min{s,t}, < s < t < oo. 

(ii) there exist numerical constants a, (3 G R a, r > and 7 < 1 + 2y / cxr such that for all 

s < t < u, 



uZ s -sZ u Z u 

(5.2) V®r[Z t \Z s ,Z u ]=F t>StU [l + a^ u - + /9 ' 



u — s u — s 

(uZ s — sZ u ) 2 (Z u — Z s ) 2 (Z u — Z s )(uZ s — sZ v 

+ o — — +r— (1 - 7)- 



where 



u — s) 2 (u — s) 2 (u — s) 5 

(u-t)(t-s) 



F t 



u(l + scr) + r — 57 



After centering and standardization, Meixner processes from Section H]are quadratic harnesses 
with parameters 7 = 1, a — a — 0. According to [20], they are uniquely determined by 
the remaining two parameters G R, r > 0: the Wiener process is a quadratic harness with 
f3 = r = 0; the (centered and scaled) Poisson process is a quadratic harness with r = 0, (3 ^ 0, 
the (centered) negative binomial process is a quadratic harness with (3 2 > 4r > (elliptic case), 
the (centered) gamma process is a quadratic harness with /3 2 = 4r > (parabolic case), and the 
(centered) hyperbolic secant process is a quadratic harness with /3 2 < 4r (hyperbolic case). 

In this section we show that stitching of such processes results in bi-Meixner processes, defined 
as quadratic harnesses with parameters such that < <tt < 1, 7 = 1 + 2y/ar, and cka/t = f3y/a. 
Examples of such processes are the bi- Poisson process [31 Proposition 4.1] and the bi-Pascal 
process [TOj Proposition 5.1]. In [TJ Proposition 2.7] we established that only bi-Meixner processes 
may result from stitching together quadratic harnesses with parameters a = a = 0. 

The following result confirms the latter and gives explicit stitching construction of all bi- 
Meixner processes. 

Theorem 5.1. Fix a Levy-Meixner process (£t) corresponding to variance function ( 14. 2p . Let 
G (60,61) be a non-degenerate random variable with the law h(d6) given by (12. 6p with parame- 
ters r > a, p G R such that k'(Q) is square integrable, and such that (12.111) . (12.121) hold, as listed 
in the third column of Tabled With v 2 = Var(/t'(0)) > ; consider process (Z t ) defined in (11.21) . 
Then (Z t ) is a quadratic harness on (0, 00). With m = p/r, the parameters are 

V'(m) a . — r + a 

a = p = - , a = t = , 7 = 1 + 2y/ar = , 

yV(m)(r-a) r-a r-a 



see also TableUl 
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Table 1 Parameters of quadratic harnesses on (0, oo), under appropriate randomization with 
parameters r, p. 



a = f3 



a = t 



domain 





i 

VP 

2 

r+2p 



2p 



v /(p 2 +r 2 )(2r-l) 2r 



r>0,p6R 
r > 0, p > 
r > 1, p > 
r > 1, p > 

^ r > 1/2, pel 



l 

r-l 



1 

r-l 



Levy process (£t 



Wiener (Example 14. 1 j) 
Poisson (Example 14. 21) 

gamma (Example I4.3[) 

negative binomial (Example I4.4H 

hyperbolic secant (Example 14.51) 



6. Proofs 

6.1. Stitching Lemma. The following technical lemma will be used to stitch together two 
quadratic harnesses on adjacent intervals. 

Lemma 6.1. Suppose a square-integrable Markov (Z t ) t ^(o,oo) is a harness , and that both (Z t ) t ^ Q ^ 
and (Z t ) te (i >00 ) are quadratic harness with the same parameters a, (3, a, r, 7. IfYai(Zi\Z s ,Z u ) is 
given by the formula ( \5.2h with t = 1, and with the same parameters a, (3, a, r, 7, then (Z t )t>o is 
a quadratic harness on (0, 00). 



Proof. Denote 
(6.1) 



Zt — Z s 
t-s ' 



A 



s,t 



tZ s — sZt 
t-s ■ 



By time-inversion, it suffices to consider formula (15. 2 p in the case s < t < 1 < u. By Markov 
property, 

Yw(Z t \Z s ,Z u ) = E(Var(Z t |Z s ,Z 1 )|Z s ,Z„) + Var(E(Z t |Z s , Z X )\Z S , Z u ) . 
Denote the right hand side of (15. 2 p by F tjSjU K(Z s , Z u ). Since ~E(Z t \Z s , Zi) is given by (13. ip . 



Var(E(Z t |7- Sjl )|7- SiU ) = % % Var(Z 1 |Z s , Z u ) 



T-s 



(t - s nu - 1) 



(1 — s)(u(l + as) + r — 7s) 



K(Z S ,Z U ). 



Next, we write 



E(Var(Z t |JT sl )|j; iU ) 



[l-t)(t-s) 



-■m{K{z s ,z x )\z 8 ,z u ) 



scr + t + 1 — 57 

Since the coefficient F ttSiU is determined by integrating both sides of (15. 2p . to end the proof, it 
suffices to show that K(K(Z S , Zi)\Z s , Z u ) is a constant multiple of K(Z S , Z u ), and we do not need 
to keep track of the constants. So it remains to show that 

(6.2) E(K(Z S ,Z 1 )\Z S ,Z U ) = C S , U K(Z S ,Z U ) 

for any s < 1 < u and some constant C s ^ u . 
We have 

(6.3) K(Z S , Z t ) = l + aA s>t + pA s>t + aA 2 s>t + T A 2 t - (1 - 7) A s , t A s 



E{K{Z S , Z 1 )\Z S , Z u ) = K{Z S , Z u ) + /n \ u K(Z S , Z u ) 
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It is easy to check that (13. ip implies 

(6.4) E(A S)t |J- SjU ) = A.,„, E(A s>t \F s>u ) = A s>u . 

Since Var(A Sit |J r SiU ), Var(A S)t | J 7 .^) and Cov(A M , A S)t | J* S)U ) are all proportional to Var(Z t | J^^), 
see f )6.ip . from (I6.4p we get 

E(A2|J- SjU ) = A 2 S , a + — -1— Vax^lJT ), 

(1-s) 2 

E(A^|j; iU ) = A s 2 )U +-^-^Var(Z 1 |jr SiU ), 

~ ~ s 
E(A Sj iA Si i|J : ; iU ) = A S)U A S)U - — -rVar(Zi|J : ; iU ) . 

(i - s y 

By assumption (ii), Var(Z]J F s ;U ) is proportional to K(Z S , Z u ). Using (16. 3p . from these formulas 
together with (16.41) we get 

r + as 2 + (1 - j)s 

which proves (16. 2p . □ 

6.2. Proof of Theorem l5.ll The proof consists of series of Claims which verify the assumptions 
of Lemma 16.11 Some steps do not rely on the specific law of and in such cases we denote 
m = E(k'(6)) and v 2 = Var(re'(e)). 
We first prove an auxiliary formula. 

Lemma 6.2. If£ t is square-integrable, (I2.12p holds and B has law (12.61) withp,r such that k'(Q) 
is square integrable, then 

(6.5) E(Var(y|0)) = srVar(«'(e)). 
Proof. Integrating by parts and using (I2.12p we get 

C [ 1 K"(9)e pe - r ^ 9) d9 = CK'(9)e p6 ' r ^ e) - / * «'(0) (p - r«'(0)) fc(cZ0) 

= r (K(6)) 2 h(d6) -pi K'(9)h(d9) = rVar(«'(e)), 

where in the last step we used (I2.14p . Since Var(xi^) = sk"(8), we get (I6.5p . □ 

Next we identify the covariance of the stitched process. 

Proposition 6.3. If (&) zs square-integrable, (12.121) holds and /ias /aw (I2.6P with p G R, 
r > snc/i £/iat «'(0) square integrable, then with v 2 = Var(/t'(0)) ; £/ie stitched process (Z t ) 
has covariance (15. ip . 

Claim 6.4. For s < t we have 

(6.6) Cav(Y„y t ) = *; 2 S (t + r) 
Taws Cov(Z s , Z 4 ) = sifs<t<l or if 1 < s < t. 

Proof. From 

Cov(Y s ,Y t ) = E(Cov(y aj y t |e)) + Cov(E(y a |e),E(y t |e)), 

we see that for s < t, Cov(y, Y t ) = sv 2 t + EVar(y s |0), and the formula follows from (16. 5p . 
Using (II. 2p . from (16. 6 \ we compute Cov(Z s , Z t ) on (0, 1) and on (1, oo). □ 
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Proof of Proposition \6.3l By Claim I6.4[ the covariance is as required for < s < u < 1 and for 
1 < s < u, so by time-reversibility argument it remains only to consider the case s < 1 < u. 

Since by the law of large numbers Y t /t — > k'(B) in mean square as t — > oo, we have Z\ = 
lim s ^.!_ Z s in mean square. Therefore, we only need to consider the case s < 1 < u. The 
argument here does not depend on the specific law of 9. Using notation ( 13 .4p . from ( II .2p we get 

Cov(Z„ Z u ) = (1 ~^~ 1) c ° v ( y ^ • 



2 2 

v r s 



By conditional independence 

Cov(F s ,,^,) = Cov(E(yy|9),E(l^|e)) = sWar^e)) 

(1 -s)(u- 1) 

So Cov(Z s , Z u ) = min{s,w} and (15. ip holds. □ 

Claim 6.5. (^t)t e (o,i) awci (^t)te(i,oo) are quadratic harnesses with the same parameters a = (3, 
a = t, 7 = 1 + l^fcrr ' , as specified in Theorem \5.1\ 

Proof. For 0<s<t<u<l, the conditional law of Y t under the bivariate conditioning is the 
same as the conditional law of £ t , see (I2.3p . So Var(F t |Y" s , Y u ) is a quadratic function of Y S ,Y U , 
as determined by the underlying Levy-Meixner process (£ t ). Specifically, for a Levy process 
generating NEF with quadratic variance function ( 14. 2p . we have 

(6.7) Var(r,|F s ,y u ) = ^^^V K 



u — s + a \ u — s 

Indeed, Var(£ t |£ s , £ u ) = Var(£ t -£ s |£ u -£ s ) is given by the same expression as Var(&_ s |£ u _ s ). To 
end the proof, we use the Laplace transform to show that for t < u, 

(6-8) Var(&|&) = ^^V(^)- 

u + a 

Differentiating the joint Laplace transform E (exp(^i^ + Z2^ u )) = exp(tn(zi + z 2 ) + (u — fjnfa)) 
at Zi — we get 

(6.9) E(£ t V 2 ^) = t/t"(z 2 )e UK(22) +t 2 {n'{z 2 )) 2 e UK{z2) . 

(6.10) E(£ u e 22 ^) = W(^ 2 )e UK(22) . 

(6.11) E(£ 2 e 22 «") = W(z 2 )e UK(22) +M 2 (/t / (^ 2 ))V K(22) . 

Since k"{z2) = V(k'(z2)) = a(ft'(,2 2 )) 2 + bn'fa) + c, we can use (16. 10}) and ( 16. lip to express 
K / (z 2 )e UK( ' 2:2 ' > an d (/« / (-2 2 )) 2 e UK ^ 22 ^ in terms of E (£ u e 22 ^") and E (£„e 22 ^). Inserting these expressions 
into right hand side of (16.91) . we get 

E ( {$ ~ -^l) e z A = ^f^E ((a& + b^ + c) e 22 ^ 

Since E(£ t \£u) = t£ u /u, it is well known that the last identity implies ( I6.8p . see [131 Section 1.1.3]. 
This proves (16. 8p and hence (16.71) follows. 

Once we have (16.71) . the reasoning is elementary. Using notation (13. 2p . 

v (7\7 7\ (V \ V V ^ {l-tf{t'-s'){u'-t') ^ (Y U ,-Y B , 

Vai(Z t \Z s ,Z u ) = — — — Vai(Y t >\Y a >,Y u >) = 5-^— — — r V 1 

r z v r z v [u — s + a) 

Noting that 

Y u i — Y s i p Z u — Z s uZ s — sZ u 

— r = - + v + v , 

u — s r u — s u — s 
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we verify that (Z t ) is a quadratic harness on (0, 1) with parameters a = (3, a = t, 7 = 1 + 2y/ar, 
as specified in Theorem 15 .11 (The calculation is omitted.) 

Quadratic harness property on (1, 00) is a consequence of time-inversion, and the parameters 
are preserved, as a = (3, a = r. □ 

Claim 6.6. If (£ t ) is a Levy-Meixner process with variance function (14 .2p and has distribution 
(12. 6p . then Var(Zi|Z s , Z u ) is given by the formula (15. 2p with t = 1, and with the parameters 
a, fl,o~, r, 7 as specified in Theorem \5.1[ 

Proof. Using the notation (13 .4p . we show that if the variance function V(m) is a quadratic 
expression, then Var(/t / (0)|F s /, Y^,) is a quadratic polynomial in Y s i,Y^,. 

As previously, let ip(x,y) be a bounded measurable function. Recall (13. 5p . Using (13.61) and 
integration by parts with respect to 9, we get 

X(#)) 2 - r~r^~r~r^ ) ( p(x,y)^dx,de,dz) 

[u + s + ry J 

k(6) (k'{9) - - + Z . + P ) ip(x,y)fi(dx,d9,dz) 
\ u + s + r J 

(p(x,y) \ K ^e)e {x+z+p)9 - {u ' +s ' +r)K{9) 6=61 





c 



u'+s'+r 



+ / K"(9)e (x+z+p)e - (u ' +s ' +r)K{e) d6]g s/ (dx)g u ,(dz). 



Since (12.121) gives 

K ff0\ e {x+z+p)6-(u'+s'+r)K(e) 

for all admissible x, z, we get 



= 

=00 



(6.12) /// ( (k'(0)) 2 - [l\ Z **X 2 ) <p(x,y)n(dx,dB,dz) 




c 



u'+s'+r 



<p(x,y) / V{K\e))e {x+z+p)e - {u ' +s ' +r)R{e) deg s \dx)g ul {dz). 



Now we use (14. 2 j) to convert (I6.12p into an equation for JJJ (k'(6)) 2 ip(x,y)n(dx,d8,dz). After a 
calculation (use (I3.6P ). from this equation we get 

(r + s + u') z y 

"A2 + iv. 1 r./ 1 „,/ + c ) y)9s'{dx)g u/ {dz) 




r + s' + u' — all V (r + s' + w'r r + s' + vf 



Thus 



r + s' + u' — a JJ \r + s' + u 



Var((«'(e)) 2 |^,y,:o = — —— V 



r + s' + w' — a \ r + s' + it' 
From (I3.8p . for some non-random constant C s>u we have 

Var(Z 1 |Z s , ZJ = <7 S , U V ( V - + v^^- + - ^ 

\r u — s it — s 
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matching the parameters that we already got for the case 0<s<t<u<l. □ 

Proof of Theorem \5.1[ From Propositions 12.11 and 13. ll we know that (Z t ) is a Markov harness. 
Proposition 16 . 3 1 shows that its covariance is (15. ip . Claims [6751 and [6761 show that the assumptions 
of Lemma \6. II are satisfied, so (Z t ) is a quadratic harness on (0, oo) with parameters as specified 
in Theorem 15.11 

□ 
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